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I In this paper, it is shown that the relative entropy is an increasing 

O ■ function of time in both the hnear regime and the non-hnear regime 

I , during the large scale structure formation in cosmology. 
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1 Introduction 

In [1] the authors have proposed a measure which quantifies the distinguisha- 
bility of the actual mass distribution from its spatial average, borrowing a 
well-known concept in standard information, the relative entropy, 

S{p\\q} = J:P^^^-, (1) 
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where {qi} is the probabihty distribution and {pi} is the actual one. For a 
continuum the relevant quantity is 

»^ = (/>ln^)z„ (2) 

VD \P)D 

where p is the actual distribution and {■ ■ ■)d is its spatial average in the 
volume Vd on the compact domain D of the manifold S. For scalar functions 
^(t, X*), the averaging operation, in term of Riemannian volume integration, 
is defined as 

{^{t,X'))D ■.= ^ I ^/gd'x ^{t,X'), (3) 

with g := det{gij) and the volume of an arbitrary compact domain, Voit) : = 
Id \f9^^^') s-^s coordinates in a t = const, hypersurface (with 3-metric 
Qij) that are comoving with fluid elements of dust: 

ds^ = -df + QijdX'dX^. (4) 

The derivative of the relative entropy with respect to the time is given in [1] 
by 

= -{Sp9}D: (5) 

Vd 

where 6 denotes the local expansion rate (as the trace of the extrinsic cur- 
vature of the hypersurfaces t — const.). Hereafter, a "dot" denotes the 
derivative respect the physical time, 4^ = /dt and 5 denotes the derivative 
of a local field from its spatial average, 5'^ = ^ — (^)d- 

In [1], a conjecture is given: The Relative Information Entropy of a dust 
matter model S{p\ \ (p) d] is, for sufficiently large times, globally (i.e. averaged 
over the whole compact manifold T.) an increasing function of time. 

In the cosmology, the 'sufficiently large times' means after the beginning 
of the non-linear regime during the structure formation. In this regime, the 
overdense elements {5p > 0) stop expanding (6 < 0) and the undcrdense 
elements {6p < 0) expand (6* > 0). So we see the conjecture is plausible. 

In this paper it will be shown that, in cosmology, the relative entropy is 
globally an increasing function of time even in the linear regime during the 
structure formation. It should be noted that this point can not be concluded 
from Eq.(5), because during the linear regime, the overdense elements {Sp > 
0) are also expanding {9 > 0). 
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Below, firstly an proof of the positivity of the entropy, S{p\\{p) d} is 
shown. Then it is shown that the entropy is globally an increasing function 
of time even in the linear regime during the structure formation. 

2 the Positivity of the Relativity Entropy 

We first express the relative entropy in term of the integral, 

S{p\\{p)d}= [ ^d'X p\n-P-. (6) 
Jd {p)d 

For an overdense volume element, its density may be taken as p = {p)d + 
5p,5p > 0. In order to ensure the average density to be (p) d, we may divide 
the overdense elements into three types. For an clement of the first type 
with p = {p)d + Sp, there must exist one or several underdense elements that 
their densities can be expressed as p = {p)d — hi6p, with hi > 0,J2ihi — 
l,i = 1,2,---. The region where the elements of the first type are localized 
is denoted by Di. 

For an overdense clement of the second type, such one or several un- 
derdense elements docs not exist. However, corresponding to several ele- 
ments of the second type, there must exist one underdense element. Writing 
the density of this underdense element as p = {p)d — Sp, the densities of 
the several overdense elements can be expressed as p = {p)d + gi^p, with 
9i > ^)Hi9i = 1, « = 2, 3, ■ ■ ■. The region where these underdense elements 
arc localized is denoted by D2- In fact, here we have given an correspondence 
between the overdense elements and the underdense elements by giving hi 
and Qi. 

Then Eq.(6) can be written as 
S{p\\{p)d} = f y/^d'X h{{p{t,X^))D,Sp{t,X^)) 

J Di 

+ f ^£X f2Mt,X'))n,Spit,X^)), (7) 
J D2 

A(po,5p) = (po + 5p) In + ^(po - hi5p) In - ^'^P , (8) 

Po i Po 

f2{po,Sp) = Y.{po + g^5p)ln^^±^ + {po-5p)\n^^, (9) 

. On On 
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where po = {p)d- The derivatives of the two functionals, fi{{p)D,Sp) and 
/2((p)d,^p), with respect to Sp, are 

Ik. = i„M£+iP + j;(_/,),,M£^>o, (10) 

^i^P) {P)d i {p)D 

<^/2 , {p)D + 9iSp {p)d-Sp , . 

— — = l^giln — In — — > 0. 11) 

T (PID {P)D 

We have used the conditions J2ihi = 1 and J2igi = 1- Then two in- 
equahties are obtained: fi{{p)D,Sp) > /i((p)d,0) = and /2((p)_D,5p) > 
/2((p)d,0) = 0. Now, due to Eq.(7), it can be concluded that the relative 
entropy, S{p\\{p)d}, is positive. 

3 the Relative Entropy as an Increasing Func- 
tion of Time in Linear Regime 

In linear regime, both Sp and (p) ^ are decreasing functions of time. Then, 
due to the results in the last section, it cannot be concluded whether S{p\ \ (p) c} 
is an increasing function or not. However, it is well known that the density 
contrast on the overdense region: 5 = is an increasing function of time 
in linear regime. Although the density contrast on the underdensc region is 
an decreasing function of time in linear regime, let's express the density con- 
trast on the under dense region a.s —6 = with 5p > and 5 > 0. Then 
5 on the underdense region is also an increasing function of time in linear 
regime. Now, rewrite the relative entropy in terms of the density contrast as 

S{p\\{p)d} = [_ d'X ^{p{t,X^))Dh{S{t,X^)) 

+ d'X ^{p{t,X'))nf2{S(t,X')), (12) 

h{6) = (l + 5)ln(l + 5) + ^(l-M)ln(l-M). (13) 

i 

h{5) = Y.i^ + g,5)\n{l + g,5) + {l-5)\n{l-5). (14) 

i 

The derivatives of the two functionals, fi{5) and /2((^), with respect to 5, are 
~f[{5) = ln(l + 5) + ^(-/i,)ln(l-M) >0, (15) 
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= + + >o, 

i 



(16) 



We have used the conditions J2ihi = 1 and J2i9i = 1- Additional, we have 
also used the equations = ~ 0. This implies we assumes that hi and 
Qi are independent of S. We beheve this is reasonable. The reason is that 
the changes in hi or gi just give another different correspondence between 
the overdense elements and the underdense elements. However, this does not 
change the relative entropy if the distribution of the density is unchanged. 
Now we know fi{S) and f2{S) are increasing functionals of S. At the same 
time, for a dust matter model, the variable y/g{p{t, X'')) d is an constant 
of time (This point has been indicated in [1].). Now, according to S as 
an increasing function of time and Eq.(12), it can be concluded that, in 
cosmology, the Relative Entropy is globally an increasing function of time in 
linear regime during the structure formation. 

4 Conjecture and Discussion 

Above, the relative entropy as an increasing function of time in linear regime 
in cosmology has been shown. The process is not same as in [1]. The deriva- 
tive of the relative entropy with respect to time is not given, but express the 
relative entropy in the density contrast. The key step in this process is the 
validity of Eq.(7). This step is believed to be correct. The analysis above 
is applicable to the non-linear regime, too. The results are summarized as 
follows. The equations (12) and (15), (16) show that the relative entropy, 
S{p\\{p) d}, is an increasing functional of the density contrast, 6. And the 
density contrast is an increasing function of time in linear regime and the 
non-linear regime. So it is concluded that the relative entropy is globally 
an increasing function of time in both the linear regime and the non-linear 
regime. 

Now a conjecture is given: The Relative Information Entropy of a dust 
matter model S{p\\{p)j:} is, globally (i.e. averaged over the whole compact 
manifold E) an increasing function of time. 

Compared with the conjecture in [1], in the conjecture here, the condition, 
"for sufficiently large times", is taken off. 

This paper just give an illustration of the conjecture during the large scale 
structure formation in cosmology. A strict proof need be explored further. 
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